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. Abstract 

Recently, designs of pseudorandom number generators (PRNGs) using integer- 
valued variants of logistic maps and their applications to some cryptographic schemes 
' have been studied, due mostly to their ease of implementation and performance. 

, However, it has been noted that this ease is reduced for some choices of the PRNGs 

accuracy parameters. In this article, we show that the distribution of such unde- 
sirable accuracy parameters is closely related to the occurrence of some patterns 
in the dyadic expansion of the square root of 2. We prove that for an arbitrary 
infinite binary word, the asymptotic occurrence rate of these patterns is bounded 
in terms of the asymptotic occurrence rate of zeroes. We also present examples of 
^ . infinite binary words that tightly achieve the bounds. As a consequence, a classical 

OO I conjecture on asymptotic evenness of occurrence of zeroes and ones in the dyadic 

expansion of the square root of 2 implies that the asymptotic rate of the undesirable 
■ accuracy parameters for the PRNGs is at least 1/6. 

'. 1 Introduction 

O 

Randomness is a ubiquitous element in our present life and can be found from a simple 
^ ■ coin toss at the beginning of a football game, to more complex settings such as encrypted 
communication of governmental secrets. The provision, application and evaluation of 
randomness has occupied a major and attractive branch of mathematics. In particular, 
there exist several methods and techniques that generate a seemingly random-looking 
sequence by using shorter random sequences (often called a seed) and deterministic al- 
gorithm, better known as a pseudorandom number generator {PRNG). See, for instance, 
[3j for references. 

In this article, we reveal a nontrivial relation between analysis of some PRNGs and 
properties of the dyadic expansion of = (1.01101 ■ ■ ■ )2. Note, however, that the dyadic 
expansion of \/2 does not appear in the construction of the PRNGs itself. Also, it has 
been shown that the logistic map 



L{x) = fix{l — x) , < X < 1 
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for some parameter can be effectively used for constructing good PRNGs ([3, [8]). In 
particular, when = 4 is adopted, the logistic map shows chaotic behavior. However, 
those PRNGs deal with real number as outputs and can therefore not be implemented 
in computers due to their finite accuracy. As a result, a modified integer- valued logistic 
map of the form: 

, xeX„ = {l,2,...,2"-l} 

where \_z\ denotes the largest integer such that N < z and 2 < n G Z is an accuracy 
parameter, has been proposed and studied in [U [3]. The definition of Ln{x) is derived 
from L{x) by expanding the bounds of the original seed x e (0, 1) to the larger interval 
(0, 2") and then truncating the final value to obtain an integer. The corresponding PRNG 
first chooses an internal state sq = s from the set X„ and then for each step i > 1, updates 
the internal state by Si = and outputs some bits in the dyadic expansion of Si. 

For the above PRNG, it has been mentioned in [1] that when Si = 2""^ for some i, the 
subsequent internal states become eventually stable, namely we have Sj+i = 2" and Sj = 
for every j > i + 2. Since internal states of PRNGs being stable are fatal for the purpose 
of providing good randomness, the value 2"~^ should not be used as an internal state. To 
concern the problem, in general it is not sufficient to exclude the value 2"~^ itself from 
the candidates of the initial internal state Sq. Namely, if there exists an x G X„ such 
that Ln{x) = 2"~^, then the choice of internal state Sq = x for such an x also makes the 
internal states eventually stable. We call the accuracy parameter n undesirable if such 
an X exists, since in such a case an extra check is required for choosing an appropriate 
initial internal state. The motivation of this work is to estimate how many undesirable 
parameters exist among the integers n > 2. 

We explain an aforementioned relation of the above PRNGs with combinatorial prop- 
erties of ^/2. Let bi G {0, 1} denote the i-th bit of the fractional part of the dyadic 
expansion of a/2, namely 

72 = (1.6iM3---)2 • 

We show that a parameter > 2 is undesirable if the {n — l)-th tail bn-ibnbn+i ■ ■ ■ of the 
dyadic expansion of begins with one of the three patterns 00, 0100, and 01010. For 
instance, since 

72 = (1.011010100000100- ■■)2 , (1) 

we have 612 = 614 = &15 = and 613 = 1, therefore the above fact implies that n = 13 
is undesirable. As a result, the occurrence rate of these three patterns in the dyadic 
expansion of ^/2 gives a lower bound of the occurrence rate of undesirable parameters. 
Motivated by the observation, we study the distributions of the three patterns in arbitrary 
infinite binary words w = wiW2W^ ■ ■ ■ , and prove that the asymptotic occurrence rate of 
the three patterns in w is bounded by a function of the asymptotic occurrence rate of 
zeroes in w. We also present construction of infinite binary words that achieve the bounds 
tightly. (See Theorem [T] for the precise statement.) This result connects the asymptotic 
occurrence rate of undesirable parameters to the distribution of zeroes in the dyadic 
expansion of \/2. For the latter, it has been conjectured that the asymptotic occurrence 
rate of zeroes in the dyadic expansion of \/2 is 1/2 (in other words, \/2 is simply normal 
to the base 2). If the conjecture is true, it follows that the asymptotic occurrence rate 



Ln{x) = 



4a:(2" - x) 




x(2" -x) 


2" 




2"-2 
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of undesirable parameters is lower bounded by 1/6, which shows a disadvantage of the 
above PRNGs. 

This article is organized as follows. In Section Ej we prove the aforementioned sufficient 
condition of an accuracy parameter n being undesirable, in terms of the occurrence rate 
of the three patterns 00, 0100, and 01010 in the dyadic expansion of \/2. In Section O, 
we state the main theorem (Theorem [1]) on a relation between the asymptotic occurrence 
rates of the three patterns and of zeroes in arbitrary infinite binary words. As a result, we 
also estimate the asymptotic occurrence rate of undesirable parameters. Finally, Section 
m gives the proof of the main theorem. 
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2 Integer- Valued Logistic Maps 

As we have mentioned in Section [H a main object of this article is integer- valued logistic 
maps Ln{x) with domain X„ = {1,2,. ..,2" — 1}, parameterized by an integer n > 2, 
defined by 



LJx) 



4x(2" - x) 




x(2" - x) 


2" 




2n-2 



xeX„ = {l,2,...,2"-l} 



(2) 



Note that Ln{x) G for any x e Xn \ {2"-^}, while L„(2"-i) = 2". We would like 
to estimate the asymptotic occurrence rate of accuracy parameters n, among all integers 
n > 2, that satisfy the following condition: 

Definition 1. We say that a parameter 2 < G Z is undesirable if there exists an x G X„ 
such that Ln{x) = 2""^ 

This definition is motivated by an analysis of some pseudorandom number generators 
(PRNGs) using Ln{x); see Section [T] for details. In the rest of this section, we show that 
the occurrence rate of undesirable parameters is related to the occurrence of the patterns 
00, 0100, and 01010 in the dyadic expansion of V2. For the purpose, first note that by 
the definition, a parameter n is undesirable if and only if there exists an a; G X„ such 
that 2""^ < x(2" - a;)/2""^ < 2""^ + 1. By solving the inequality, it follows that this 
condition for x is equivalent to 



^22"-3 - 2"-2 < 12"-^ -X\< V22"-3 



Moreover, since 



in-2 



)n-2 



2n-3 



-)n-2 



V22^+ V2 



> 



the condition ^ is satisfied if 2"-2v^- < |2"-i 

have the following lemma: 



2n-3 _ 2"-2 2V22"~3 

-x\< 2"-2^. g 



(3) 



V2 
4 ' 

ummarizing, we 
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Lemma 1. A parameter n > 2 is undesirable z/2" ^-\/2 — -\/2/4 <m< 2"-2^ for some 
integer m. 

This lemma can be rephrased in terms of the dyadic expansion of as follows. Let 
a/2 = (I.6162&3 ■ ■ ■ )2 be the dyadic expansion of \/2. For instance, we have 61 = 0, 62 = 1 
and 63 = 1 (see ([T])). Then the fractional part of the dyadic expansion of 2""^-\/2 is 
(O.bn-ibnbn+i ■ ■ ■)2, whilc the dyadic expansion of is (O.OI6162&3 ■ ■ ■ )2- By using 

these expressions, Lemma [T] implies the following: 

Lemma 2. In the above setting, a parameter n > 2 is undesirable if 

{^K-lbnbn+l • ■ • )2 < (O.OI6162&3 ■ • ■ )2 • (4) 

Since 6162&3 = Oil, the condition (jl]) is satisfied if = 00, bn-ibnbn+ibn+2 = 0100, 

or bn-ibnbn+ibn+2bn+3 = 01010. Summarizing, we obtain the following sufficient condition 
for an accuracy parameter n being undesirable: 

Proposition 1. In the above setting, a parameter n > 2 is undesirable if bn~ibn = 00, 

bn-lbnbn+lbn+2 = 0100, Or 6„„i6„6„+i6„+2&n+3 = 01010. 

Remark 1. In general, the sufficient condition given by Proposition [1] is not necessary 
for a parameter n > 2 being undesirable. More precisely, there exists a gap between the 
sufficient conditions in Proposition [T] and in Lemma [21 For instance, n = 65 satisfies the 
condition (jlj) but not the condition in Proposition [H Thus a more precise study of the 
condition (jlj) would provide a better result. The author hopes that the condition (jlj) can 
motivate further interesting arguments by its self-referential structure. 



3 Occurrence Rates of the Three Patterns 

Motivated by Proposition [H in this section we investigate the asymptotic occurrence rate 
of the three patterns 00, 0100, and 01010 in an infinite binary word. The result will be 
used to estimate the asymptotic occurrence rate of undesirable parameters. 

To formulate the problem, we introduce the following notations. For a finite or infinite 
binary word w = W1W2W3 ■ ■ ■ {wi G {0, 1}), let l{w) denote the length of w. Let P{w) 
denote the set of indices z > 2 in w such that one of the following three conditions holds: 

• C-iw) > i and Wi-iWi = 00; 

• ^{w) >i + 2 and Wi-iWiWi+iWi+2 = 0100; 

• ^{w) > i + 3 and Wi-iWiWi+iWi+2'Wi+3 = 01010. 

By Proposition [H a parameter n > 2 is undesirable if G P{b), where b = 61&2&3 ■ ■ ■ is 
the fractional part of the dyadic expansion of y/2 as an infinite binary word. Let ' 
denote the initial subword of w of length k. Moreover, let Z{w) denote the set of indices 
i in w such that Wi = 0. Then our main theorem in this section shows relations between 
the quantities 

|Z(w("))| |P(w("))| 
Tinfiw) = limini and -Rinf (w) = liminf , (5) 

n^oo n n— >oo n 
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and relations between the quantities 



'^sup(w^) = limsup and i?sup(w^) = limsup . (6) 

n^oo IT' n— >oo IT- 

By using the above notations, we state the main theorem as follows: 

Theorem 1. For any infinite binary word w = W1W2W3 ■ ■ ■ , let (w), r^npiw), Ri^iiw), 
and Rsup{w) be defined in ^ and Then we have 

5rinf(w) — 2 n / \ / \ Srsupfty) — 2 

< Rindw) < rinf(w) and < Rsup{w) < rsup(w) • (7) 

Moreover, for any real number 2/5 < r < 1, there exists an infinite binary word w such 
that rinf(w) = Tsupiw) = r and Rin{{w) = Rsup{w) = (5r — 2)/3, therefore the lower 
bounds are achieved. Similarly, for any < r < 1, there exists an infinite binary word 
w such that rinf{w) = Tsupiw) = r and i?inf(x) = -Rsup(a;) = r, therefore the upper bounds 
are achieved. 

Note that the lower bounds of i?inf(w) and Rsup^w) become trivial if ri^{{w) < 2/5 
and rsup(w) < 2/5, respectively. The proof of Theorem [1] will be given in Section HI 

Regarding the problem in Section [21 by applying Theorem [T] to the above word w = b 
of the fractional part of the dyadic expansion of ^/2, we have the following theorem: 

Theorem 2. In the above setting, let denote the number of the undesirable parameters 
n < N . Then we have 

■ ^ 5rini{b) -2 c/tv 5rsup(6) -2 
hm mt — > and hm sup — > . 8 

In particular, if rsupib) > 2/5, then there exist infinitely many undesirable parameters. 

As a result, the (lower bound of the) asymptotic occurrence rate of zeroes in the dyadic 
expansion of \/2 yields a lower bound of the asymptotic occurrence rate of undesirable 
parameters. Note that there has been the following long-standing conjecture: 

Conjecture 1. \/2 is simply normal to base 2; that is, the asymptotic occurrence rate 
of zeroes in the dyadic expansion 0/ a/2 is 1/2 (i.e., rinf(6) = Tsup(&) = 1/2 ihe above 
notations). 

This conjecture reflects our naive intuition that the dyadic expansion of -\/2 looks 
very random. There have been some further observations that sound positive for the 
conjecture. For instance, Borel [2] proved that almost every real number (in terms of 
Lebesgue measure) is simply normal to base 2 (more strongly, is normal to every base 
g > 2). By combining Conjecture [1] to Theorem [21 we obtain the following result, that is 
very likely to show a disadvantage of the PRNGs mentioned in Section [TJ 

Corollary 1. // ConjectureUl is true, then the numbers dN of undesirable parameters 
n < N satisfy that liminfAr^oo ^at/A^ > 1/6. 
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4 Proof of Main Theorem 



In this section, we give a proof of Theorem [T] in Section [3l First, the upper bounds of 
i?inf (w) and Rsup{w) in ([7]) follow simply from the fact that the map i i—1 is an injection 
from P{w) to Z{w) for any finite binary word w. For the remaining assertions, first in 
Section HIT] we prove the lower bounds in (JTj). Secondly, in Section we construct, 
for any 2/5<r<l, an infinite binary word w such that rinf(w) = rsup(w) = r and 
Riniiui) = Rsnp{w) = (5r — 2)/3. Finally, in Section IT3] we construct, for any < r < 1, 
an infinite binary word w such that rinf(w) = r^npiw) = r and Ri^{{w) = Rsnp{u)) = r. 



4.1 Proof of Lower Bounds 

We prove that Ri^f{w) > (5rinf(w) — 2)/3 and Rsnp{w) > (5rsup('w) — 2)/3 for any infinite 
binary word w. In the proof, we use the following notations. For any (finite or infinite) 
word w = W1W2W3 ■ ■ ■ and indices I < i < j < i{w), let W[ij] = WiWi+i ■ ■ ■ Wj-iWj. Let 
denote the empty word. Let Wn denote the set of binary words of length N. Let -< denote 
the lexicographic order on Wn excluding equalities, for instance, we have 1011 -< 1100 
and 0010 -A 0010. For two words w and w', we write w C w' if w = w'^ij] for some indices 
i < j. Let = WW ■ ■ - w (j repetition of w) for any integer j > 0. 

The outline of our proof is as follows. In the proof, we investigate the maximum 
value of the number of zeroes in m G Wn subject to the condition that |-P(m)| 

is upper bounded by a fixed value. This will yield a relation between the quantities 



\i"[w'-"')\ and for each initial subword w*-"-* of a given infinite binary word w, 

from which the desired lower bounds will be derived. For the purpose, we will introduce 
some "elementary transformations" for the words u G Wn that preserve i{u) and 
and do not increase |P('u)|. By iterating such elementary transformations, our argument 
will be reduced to the case of words in Wn of some "normal form" that can be dealt with 
by case-by-case analysis. 

We start the above program. First, we introduce the following seven maps ipk '■ Wn —>■ 
Wn, 1 < /c < 7, as aforementioned elementary transformations, where v and v' signify 
some (possibly empty) binary words. We define 



IPvO , if u = vOlP, p>l ; 
u , otherwise 



(namely, ipi moves the ones at the tail of the word m, to the front of u; for instance, 
^1 (1010011) = mOlOO and fixes 10100), 



W+^vllv' , if u = Wvlllv', p > 0, 111 ^ 0, vi = v^^v) = ; 
u , otherwise 



(namely, (p2 picks up a one from the first block of at least three consecutive ones after 
a zero and moves it to the front; for instance, y^(l^OllOl^Ol^O) = 1^01101^01^0 and ip2 
fixes 1^0011010), 



vOllQP-h' ,iiu = vOniv', p>2, 0011 ^ v, ve(v) ^ ; 
u , otherwise 
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(namely, <^3 focuses on the first block of the form 0^11 with p > 2, and moves all but 
one zeroes m that block to the tail of that block; for instance, ^3(110110llll00110) = 
11011 0110^ 100110 and (^3 fixes 1011011), 



vOllOO^;' , if w = -yOlOlO^;', 01010 ^ ^;010 ; 
u , otherwise 



(namely, (f^ focuses on the first block of the form 01010, and permutes the third and 
the fourth bits in that block; for instance, (/9zi(11 01010 10) = 11 01100 10 and 994 fixes 
011010110101), 



vlQP+^v' ,iiu = vOnOQv', p > 1, 0100 ^ vQp, ve^^) 7^ ; 
u , otherwise 



(namely, 995 focuses on the first block of the form 0^100 with p > 1, and moves the 
imiquc one in that block to the front of that block; for instance, (10011 0^100 100) = 
1001110^100 and <^5 fixes 100110010), 



vOlOllOV , if w = vO^'lOllO^;', p > 2, 0010110 ^ vQp, v^^y) ^ 0; 
u , otherwise 



(namely, (fe focuses on the first block of the form 0^10110 with p > 2, and moves all 
but one zeroes at the beginning of that block to the tail of that block; for instance, 
(Pf^d O^lOllO OlOllOO) = 1 010110^ 0101100 and cpe fixes 1010110), and 



vlOlOllO^;' , if = -uOllOllO^;', 0110110 ^ ^;0110 ; 
u , otherwise 



(namely, Lpj focuses on the first block of the form 0110110, and permutes the first and 
the second bits in that block; for instance, Q?7fl^0 0110110 110) = 1^0 1010110 110 and 997 
fixes 0111011010). 

Let denote the set of all u e Wn that are fixed by every v^fc, 1 < /c < 7. Note 
that each of the seven maps is well-defined and satisfies that £{ipk{u)) = £{u) and 
|Z'((/9fc(-u))| = |Z(-u)|, since (fk is just a permutation of bits in a given word. Moreover, 
it follows immediately from the definition that each 9?^ is a weakly increasing map with 
respect to -<, namely we have u :< ^ki^)- Since Wj^ is a finite set, this implies that each 
u e Wn can be transformed to a word u e VF^ by finitely many times of applications of 
the maps v^a;, 1 < ^ < 7. Note that this u is not necessarily unique for a given u G Wn 
due to various choices of the order of applying the maps (pk- 

To reduce our argument to the case of the words in W^, we would like to show that 
|P(m)| < |-P(m)| for any u G Wn- For the purpose, it suffices to show that \P{^pk{'^))\ < 
|P(ii)| for every map </7fe, 1 < A; < 7. This is proceeded by the following seven lemmas, 
where we use the notation: 

Pi,j{u) — P{u) n {i, i + 1, . . . , J — 1, j} for any indices i < j va. u & Wn ■ 

Before giving the lemmas, note that for any word u and any index i, 

we have i ^ P{u) unless i >2 and = , (9) 
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therefore 1 ^ P{u). Similarly, 



if Ui = 1, then we have i ^ P{u) unless 2 < i < i{u) — 1 and = Wj+i = . (10) 

Moreover, it is obvious that 

whether i G P{u) or not depends solely on U[i-i^i+3] . (11) 

Now we show the lemmas as follows, where we write u' = (pk{u) for the map ipk under 
consideration: 

Lemma 3. Ifu G Wn, then \P{ifi{u))\ = \P{u)\. 

Proof. It suffices to consider the case that u' ^ u, namely u = fOl^ and u' = WvO with 
p > 1, as in the former case of the definition of ipi. Now if x = u'^^_ij^ is a subword in u' 
of one of the three forms 00, 0100, or 01010, corresponding to an index i G P{u'), then 
X should be contained in vO by the shapes of x and u', therefore M[j_i_pj_p] = x and 
i — p E P{u). Similarly, if x = is a subword in u of the form 00, 0100, or 01010, 

corresponding to an i G P{u), then x C vO, therefore M'j_i+p j_|.p] = x and i + p E P{u'). 
Thus i I— i +J9 is a bijection P{u) — P{u'), therefore Lemma [S] holds. □ 

Lemma 4. Ifu G Wn, then \P{ip2{u))\ = \P{u)\. 

Proof. It suffices to consider the case that u = l^wlllf' and u' = I'^'^^vllv' as in the 
former case of the definition of <^2- Now by the shapes of u and u', any subword in u of 
the form 00, 0100, or 01010 is contained in either v or v', and the same also holds for u'. 
This implies that there exists a bijection P{u) P{u'), hence Lemma H] holds. □ 

Lemma 5. Ifu G Wn, then \P{if3{u))\ < \P{u)\. 

Proof. It suffices to consider the case that u = fO^'llf' and u' = fOllO^^^f' as in the 
former case of the definition of (p^. Put i = i{v). Then for any subword x in u' of the form 
00, 0100, or 01010 corresponding to an i G P{u'), one of the following four conditions is 
satisfied: 

1. X is contained in the block f 0; 

2. X = 00 and x is contained in the block O''"^ (thus i + 5 < i < i + p + 2); 

3. i = i + p + 3, namely i is the first position of the block v'; 

4. X is contained in the block v'. 

In the cases 1 and 4, x is also contained in u and we have i G P{u). In the case 2, x 
is also contained in the last p — 1 bits of the block 0^ in m, and we have z — 2 G P{u). 
Moreover, we have ^ + 2 G P{u) since p > 2. Thus there exists an injection P{u') P{u) 
that maps i G P{u') to i for the cases 1 and 4, to z — 2 for the case 2, and to £ + 2 for the 
case 3. Hence Lemma holds. □ 

Lemma 6. Ifu G Wn, then \P{ipi{u))\ < \P{u)\. 
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Proof. It suffices to consider the case that u = vOlOlOv' and u' = fOllOOf' as in the 
former case of the definition of ip^. Put £ = i{v). Then for any subword x in u' of 
the form 00, 0100, or 01010 corresponding to an z G P{u'), one of the following three 
conditions is satisfied: 

1. X is contained in the block vO; 

2. i = i + 5, namely i is the last position of the block 01100; 

3. X is contained in the block Ov' (thus i + 6 < i). 

In the cases 1 and 3, x is also contained in u and we have i G P{u). Since £ + 2 G P{u), 
there exists an injection P{u') — > P{u) that maps i G P{u') to i for the cases 1 and 3, 
and to £ + 2 for the case 2. Hence Lemma E] holds. □ 

Lemma 7. Ifu G Wn, then \P{if5{u))\ < \P{u)\. 

Proof. It suffices to consider the case that u = f O^lOOf ' and u' = vlO^^'^v' as in the former 
case of the definition of ip^. Put i = i{v). Note that p > I and f £ 7^ by the definition 
of <^5- Then for any subword x in u' of the form 00, 0100, or 01010 corresponding to an 
i G P{u'), one of the following four conditions is satisfied: 

1. X is contained in the block u; 

2. X is contained in the first p bits of the block 0^^^ (thus i + 3 < i < i + p + 1)', 

3. i = i + p + 2, namely i is the second last position of the block O^"*"^; 

4. X is contained in the block OOv'. 

In the cases 1 and 4, x is also contained in u and we have i G P{u). In the case 2, x 
is also contained in the block 0^ in m, and we have i — 1 G P{u). Moreover, we have 
i + p + 1 G P{u) since p > I (namely U[i^p^e+p+s] = 0100). Thus there exists an injection 
P{u') P{u) that maps i G P{u') to i for the cases 1 and 4, to z — 1 for the case 2, and 
to £ + p + 1 for the case 3. Hence Lemma [7| holds. □ 

Lemma 8. Ifu G Wn, then \P{ipfi{u))\ < \P{u)\. 

Proof. It suffices to consider the case that u = t;0^10110w' and u' = i;010110^f' as in 
the former case of the definition of cpQ. Put i = i{v). Note that p > 2 and V£ ^ 
by the definition of cpQ. Then for any subword x in u' of the form 00, 0100, or 01010 
corresponding to an i G P{u'), one of the following four conditions is satisfied: 

1. X is contained in the block vO (thus i < £ — 1 since 7^ 0); 

2. i>2, vie.i^e] = 01, x = 01010 and i = i; 

3. X is contained in the block 0^ (thus i + 7 < i < i + p + 5); 

4. X is contained in the block Of' (thus i + p + 6 < i). 
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In the cases 1 and 4, x is also contained in u and we have i G P{u). In the case 3, x is 
also contained in the block O*' in m, and we have z — 5 G P{u). Moreover, in the case 2, 
we have I G P{u) since p > 2 (namely M[£_i/+2] = 0100). Thus there exists an injection 
P{u') — >■ P{u) that maps i G P{u') to i for the cases 1 and 4, to z — 5 for the case 3, and 
to i for the case 2. Hence Lemma [H] holds. □ 

Lemma 9. Ifu G Wn, then \P{(p7{u))\ < 

Proof. It suffices to consider the case that u = fOllOllOf' and u' = flOlOllOf' as in 
the former case of the definition of (pj. Put £ = i{v). Then for any subword x in u' 
of the form 00, 0100, or 01010 corresponding to an i G P{u'), one of the following four 
conditions is satisfied: 

1. X is contained in the block v; 

2. i>l,vg = 0,x = 01010 and i = £ + 1; 

3. X is contained in the block Ov' (thus i + 8 < i). 

In the cases 1 and 3, x is also contained in u and we have i G P{u). Moreover, in the 
case 2, we have £ + 1 G P{u) (namely = 00). Thus there exists an injection 

P{u') — > P{u) that maps i G P{u') to i for the cases 1 and 3, and to £ + 1 for the case 2. 
Hence Lemma [9] holds. □ 

Thus we have proven that |-P(tt)| < |-P(m)| for any u G Wn as desired. From now, 
we determine the possibilities of the shape of w G W^. For the purpose, first we show 
that any word in W"^ does not contain a subword of type 1-11 in Table [H For instance, 
if M G W^, then we have 010111 ^ u since 010111 is a word of type 2. In fact, only 
subwords of types 1, 2, 4, 5, 7, and 11 will appear in the subsequent argument. However, 
we also include other subwords in Table [T] since these are used in the proof of the above 
fact (Lemma [TU] below). Now we show the following lemma: 



Table 1: Excluded subwords for words in 
Here f is a (possibly empty) word, and ')' for type 1 denotes the tail of the word u. 



type 


subword 


type 


subword 


type 


subword 


1 


Ovl) 


2 


Oi;lll 


3 


0011 


4 


01010 


5 


0100 


6 


0010110 


7 


0110110 


8 


001011 


9 


00101 


10 


OOlOt; {v ^ 0) 


11 


OOlf {v ^ 0) 





Lemma 10. Any u G Wfj does not contain a subword listed in TableUi 

Proof. First, we show that for each 1 < < 7, we have (pk{w) ^ w ii w & Wj^ contains a 
subword x of type k in Table [TJ It suffices to show that w satisfies the condition in the 
first case of the definition of ^pk- In the case /c = 1, by focusing on the last zero in x and 
the subsequent part of x (the former exists and the latter is nonempty by the shape of 
x), it follows that w ends with 01^, p > 1, therefore the claim holds. In the case k = 2, 
the shape of x implies that w contains a subword of the form 0111 (consider the last zero 
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in X and the subsequent part of x), and by focusing on the leftmost such subword in w 
the claim follows. In the case k = 3, the shape of x implies that w contains a subword 
of the form 0^11, p > 2, and by focusing on the leftmost such subword in w the claim 
follows. In the case k = 4, the claim follows by focusing on the leftmost subword in w of 
the form 01010 (the same as x). In the case k = 5, the shape of x implies that w contains 
a subword of the form 0^100, p > I, and by focusing on the leftmost such subword in w 
the claim follows. In the case k = 6, the shape of x implies that w contains a subword of 
the form 0^10110, p > 2, and by focusing on the leftmost such subword in w the claim 
follows. Finally, in the case k = 7, the claim follows by focusing on the leftmost subword 
in w of the form 0110110 (the same as x). Thus we have shown that any u G does 
not contain a subword of types 1-7 in Table [TJ 

For subwords of type 8, if 001011 C u, then u must contain one of the three subwords 
0010110, 0010111, and 001011) that are of types 6, 2, and 1 in Table[Il respectively. This 
contradicts the previous paragraph, therefore 001011 ^ m as desired. 

For subwords of type 9, if 00101 C u, then u must contain one of the three subwords 
001010 (that contains a subword of type 4 in Table [T]), 001011 (a subword of type 8 in 
Table [I]), and 00101) (a subword of type 1 in Table [I]). This contradicts the previous 
paragraphs, therefore 00101 (^u as desired. 

For subwords of type 10, if OOlOw C u for some word f 7^ 0, then u must contain 
one of the two subwords 00100 (that contains a subword of type 5 in Table [T]) and 00101 
(a subword of type 9 in Table [T]). This contradicts the previous paragraphs, therefore 
OOlOw ^ M as desired. 

Finally, for subwords of type 11, if OOlv C u for some word v 7^ 0, then u must contain 
one of the three subwords OOlOw' with 7^ (a subword of type 10 in Table [1]), 0011 (a 
subword of type 3 in Table [T]), or 001) (a subword of type 1 in Table [T]). This contradicts 
the previous paragraphs, therefore OOlf ^ m as desired. Hence Lemma [TU] holds. □ 

Owing to Lemma fTOl we obtain the following classification of the words in W^: 
Lemma 11. Any wordu in is of one of the seven types in TablelM 

Proof. First, note that any u G can be expressed in the following form: 

u = iPoo^ipi ■ . .0«nP'=0^''-+S A; > 0, po > 0, qk+i > 0, > 1, > 1 (1 < i < A;) . 

We apply Lemma [TO] to this u. First, the absence of a subword of type 1 in Table 
[1] implies that u does not end with a one unless u contains no zeroes. Thus we have 
Qk+i > 1 if A; > 1. Secondly, the absence of a subword of type 2 in Table [1] implies that 
three consecutive ones do not appear after a zero, therefore we have pj G {1, 2} for every 
1 < i < k. Moreover, the absence of a subword of type 11 in Table [T] implies that if 
001 C u, then a zero should follow that subword 001 immediately and u should end with 
that zero. By these conditions, the possible shapes of u are classified as follows: 

1. u = IPoQ'^^ (corresponding to the case k = 0); 

2. u = PoOP^O''^, pi G {1, 2}, q2 > 1 (corresponding to the case A; = 1, = 1); 

3. u = P°0''UO, qi > 2 (corresponding to the case A; = 1, > 2); 
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Table 2: Classification of words u in W] 



Type 1 


u = F0« (p > 0, g > 0) 






N = p + q 






\Ziu)\ = q \Piu)\ = q-l 




Z{u) /N = P{u) /N + 1/N 


Type 2 


u = F(01011)"OnO (p > 0, g > 2, s > 0) 






N = 5s + p + q + 2 






Z{u)\ = 2s + q + l |P(M)| = g-l 






Z{u)\/N = 3/5 ■ \P{u)\/N + 2/5 + 4/(5A^) - 2p/{5N) 


Type 3 


u = F011(01011)"OnO (p > 0, g > 2, s > 0) 






iV = 5s + p + g + 5 






Z{u)\ = 2s + q + 2 \P{u)\ = q-l 






Z{u)\/N = 3/5 ■ \P{u)\/N + 2/5 + 3/{5N) - 2p/{5N) 


Type 4 


M = 1^(01011)^09 (p > 0, g > 1, s > 1) 






N = 5s + p + q 






\Z{u)\ = 2s + q |P(M)| = g-l 






Z{u) /N = 3/5 ■ P{u) /N + 2/5 + 3/(5iV) - 2j9/(5A^) 


Type 5 


M = F011(01011)'09 (p > 0, g > 1, s > 0) 






N = 5s + p + q + 3 






Z{u)\ = 2s + q + l |P(M)| = g-l 






Z{u) /N = 3/5 ■ P{u) /N + 2/5 + 2/(5A^) - 2p/(5iV) 


Type 6 


M = F(01011)"010 {p>0,s>0) 






N = 5s + p + 3 






\Z{u)\ = 2s + 2 \p{u)\ = Q 




\Z{u)\/N = 2/5 + A/{5N) - 2j9/(5iV) 


Type 7 


M = F011(01011)^010 (j9>0, s>0) 






N = 5s + p + Q 






\Z{u)\ = 2s + 3 |P(m)| = 




\Z{u)\/N = 2/5 + 3/(5A^) - 2p/{5N) 



A. u = FoOFi ■ . .OF'=-iOF'=0'"=+i, pi E {1,2} (1 < z < k), qu+i > 1 (corresponding to 
the case k > 2, q^ = 1); 

5. u = FOOF^ ■ ■ ■OF^-iO'?nO, Pi G {1,2} {I < i < k), qk > 2 (corresponding to the 
case > 2, gfc > 2). 

Case 1 corresponds to Type 1 in Table El In Case 2, a choice pi = 1 implies that g2 = 1 
by the absence of a subword 0100 of type 5 in Table [1], and it corresponds to Type 6 in 
Table [2] with parameter s = 0. On the other hand, the other choice pi = 2 corresponds 
to Type 5 in Table [2] with parameter s = 0. Case 3 corresponds to Type 2 in Table [2] 
with parameter s = 0. 

The remaining part of the proof focuses on Cases 4 and 5. In Case 4, the absence of 
a subword 01010 of type 4 in Table[T]and a subword 0110110 of type 7 in Table [1] implies 
that {pi,pi+i) = (1, 2) or (2, 1) for each 1 < i < k — 1. Thus the sequence {pi,P2, ■ ■ ■ ,Pk) 
is of one of the four forms (1, 2, 1, 2, . . . , 1, 2), (1, 2, 1, 2, . . . , 2, 1), (2, 1, 2, 1, . . . , 2, 1), and 
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(2, 1, 2, 1, . . . , 1, 2). The first and the fourth cases correspond to Type 4 and Type 5 in 
Table El respectively. On the other hand, the second and the third cases correspond to 
Type 6 and Type 7 in Table [2], respectively, since now we have pk = 1 and the absence 
of a subword 0100 of type 5 in Table [T] implies that g/c+i = 1. 

Finally, in Case 5, the fact Qk > 2 and the absence of a subword 0100 of type 5 in 
Table [U imply that pk-i = 2. Now by the same argument as the previous paragraph, the 
sequence {pi,P2, ■ ■ ■ ,Pk-i) is either (1, 2, 1, 2, . . . , 1, 2), or (2, 1, 2, 1, . . . , 1, 2). These cases 
correspond to Type 2 and Type 3 in Table El respectively. Hence Lemma [H] holds. □ 

Table El also includes, for each u G W^, relations for the values N, \Z{u)\, \P{u)\, p, 
q (except for Types 6 and 7), and s (except for Type 1). 

From now, we present the main part of the proof of lower bounds in Theorem [TJ First 
we show that Ri^f{w) > (5rinf(w) — 2)/3 for any infinite binary word w. This is trivial 
if rinf(w) < 2/5, therefore we focus on the case rinf(w) > 2/5. Now we associate a (not 
necessarily unique) word y{n) = w^"-) in to each initial subword lu^"-* G Wn of w 
by applying the maps (fi, 1 < i < 7, repeatedly. Note that \Z{y{n))\ = |Z(u;("))| and 
\P{y{n))\ < \P{w^^^)\ by the above argument. Now we have the following: 

Lemma 12. y{n) G is not of type 6 or 7 in TablelE for any sufficiently large n. 

Proof. Assume contrary that y{n) is of type 6 or 7 for infinitely many n. Then we have 
|Z(w("))|/ra = \Z{y{n))\/n < 2/5 + 4/(5n) for those n by Table El Note that the right- 
hand side converges to 2/5 when n oo. On the other hand, by the assumption rinf(w) > 
2/5, there exists an integer N and a constant c > such that \Z{w^^^)\/n > 2/5 + c for 
any n > N. This is a contradiction. Hence Lemma [12l holds. □ 

If y{n) is of type 1 in Table El then we have 

|P(^W)| ^ |P(y(n))| ^ \Ziyin))\ _ 1 ^ |^(t^("))| _ 1 _ ^^2) 



n n n n n n 

On the other hand, if y{n) is of types 2-5 in Table El then we have 

|P(«;("))| ^ \P{y{n))\ 5 \Z{y{n))\ 2 c , 2p 



n n 3 n 3 3n 3n 

^ 5 |Z(«;("))| 2 4 
~ 3 n 3 3n ' 



(13) 



where c = 4, 3, 3, and 2 in the case of types 2, 3, 4, and 5, respectively. Now we have 
|Z(w'-"'^)|/n < 1 by the definition, therefore the right-hand sides of ( fT2l) and ( fT3l) are 
larger than or equal to 5/3 • \Z{w'^'^'^)\/n — 2/3 — 4/(3n). This implies that 

\P{w^-))\ ^ 5 \Z{w^^))\ 2 4 ^^^^ 



n 3 n 3 3n 

for any n such that y{n) is of types 1-5. By Lemma any sufficiently large n satisfies 
the condition. Now the desired bound Pinf(w) > (5rinf(w) — 2)/3 is derived by taking the 
liminfn^oo of both sides of ( |T^ . 

Secondly, we show that Rsupiw) > (5rsup(w)— 2)/3 for any infinite binary word w. This 
is trivial if r^npiw) < 2/5, therefore we focus on the case that r^npiw) > 2/5. We define 
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y{n) G for each n in the same way as above. Now it suffices to show that, for any 
e > 0, there exist infinitely many indices n such that \P{w^"^)\/n > (5rsup(u^) — 2)/3 — e. 
Take an e' such that < e' < 3£:/10 and e' < rsup{w) — 2/5. Then by the definition of 
Tsupiw), there exist infinitely many indices n such that \Z{w^^^)\/n > rsup{w) — e'; let J\f 
denote the (infinite) set of such indices n. Now we have the following: 

Lemma 13. y{n) G is not of type 6 or 7 in Tahle\^for any sufficiently large n G M . 

Proof. U n E Af and y{n) is of type 6 or 7, then we have \Z{y{n))\/n < 2/5 + A/{5n) 
by Table El while \Z{y{n))\/n = \Z{w^^'')\/n > rsup{u)) — e' by the definition of M. 
Thus we have 4:/{5n) > rsnp{w) — e' — 2/5 for such an n. On the other hand, we have 
Vsupiw) — e' — 2/5 > hj the choice of e'. This implies that the condition for n is not 
satisfied when n G A/" is sufficiently large. Hence Lemma [T3] holds. □ 

By Lemma [THl we may assume without loss of generality that y{n) is of Types 1-5 
for any n G A/". 

The relation ( |T4l) above also holds in this case if y{n) is of types 1-5 in Table [21 By 
Lemma [I3l any sufficiently large n E M satisfies this condition. For those (infinitely 
many) n, the definition of TV and the choice of e' imply that 



|P(^ 5 , 2 4 5r..p(^) -2 e 4 

n 6 6 in 6 2 in 



Moreover, the right-hand side of (ITSll is larger than (5rsup(u^) — 2)/3 — e if is sufficiently 
large. Thus we have \P{w^'^'')\/n > (5rsup('w) — 2)/i — e for infinitely many n. Since e > 
is arbitrary, it follows that -Rsup(u^) > (5rsup(w) — 2)/3 as desired. Hence the proof of 
lower bounds in Theorem [H is concluded. 



4.2 Construction of Words Achieving Lower Bounds 

We show that for any 2/5 < r < 1, there exists an infinite binary word w such that 
^infiw) = Tsupiw) = r and -Rinf(ty) = Rsupiw) = (5r — 2)/3. First, if r = 2/5, then 
w = 0101101011 ■■ ■ (infinite repetition of 01011) satisfies the condition. On the other 
hand, if r = 1, then w = 0000 ■ ■ ■ (infinite repetition of 0) satisfies the condition. From 
now, we focus on the remaining case 2/5 < r < 1. 
We introduce some auxiliary notations. First, put 



P 



5r - 2' 



3 5r-2 
and a = p + — = p — 



where \z~\ denotes the smallest integer such that z < N . Then we have 1 < p < oo 
and < a < 1 since 2/5 < r < 1. Let a = (0.aia2 ■ ■ ■ )2 be the unique dyadic expansion 
of a with infinitely many zeroes. By using these notations, we define finite binary words 
w^^\w''^\ . . . such that w^*^ is a proper initial subword of for each i > by 

= and w^^ = w^'-^^w^'-^^OlOllQP-''^ for i > 1 . 

By the construction, the sequence w^'^^w^^'^, . . . converges to an infinite word. We define 
w to be the limit of the sequence. We show that this w satisfies the above condition. For 
simplicity, put 



[w 



<*>) , Ci = l^(«^^*^)l , = |P(w;<*>)| for each i > 1 
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These quantities are calculated as follows: 



Lemma 14. For any i > 1, we have 

i i 

U = (2' - l)(p + 5) - ^ 2-^«,- , a = (2^ - l)(p + 2) - J] , 

i=i i=i 

'i 

TTi = (2^ - l)p - 1 - ^ 2'-^a^ + (5p,iQ;i , 
where 5afi denotes the Kronecker delta. 

Proof. We prove the lemma by induction on i. Since w^^^ = 010110^""^, the case i = 1 is 
derived by a direct calculation. Prom now, we consider the case i >2. 

For £i and Q, the construction of w^*^ and the induction hypothesis imply that 

ii = 2ii_i +p-ai + 5 

i—l i 

= (2(2-1 _ 1) + + 5) _ 2 ^ T-^-^aj - a, = - l)(p + 5) - ^ T-^aj , 

i— 1 i 



(2(2-1 _ 1) + + 2) - 2 5^ 2-i-^a,- - a, = (2' - l)(p + 2) - T'^ 



a 



therefore the claim holds. We deal with the value tTj in the rest of this proof. First, note 
that by the construction of w^'^\ each one in has one of the three properties; it is 
followed by a one, it is followed by Oil, and it is preceded by a one. This implies that an 
index j with {w^^^)j = 1 cannot be a member of the set P{w^^^). Thus by the definition 
of P(w^*^), we have j G P{w^'''^) if and only if j > 2 and {w^^'^)j^i = (w^*'')j = 0. 

First wc consider the case p > 2. In this case, ?i;^— ends with a zero regardless of 
the value ctj-i G {0, 1}, while w^—^^ begins with a zero. Thus the members of P{w^'^'^) are 
classified into the four types; those induced by P(w^— for the first two blocks w^'^"^^ in 
tyW — ■u;^*~i^w^*~i^010110^^"% the first position in the second w^*~i\ the first position in 
the last block 010110^^"% and the last p — ccj — 1 positions in the last block 01011CP~"\ 
Summarizing, we have 



TTj = 27r,_i + p-ai + l 



i-1 



= (2(2-1 _ 1) + _ 2 + 1 _ 2 ^ 2-i-^aj - = (2* - l)p - 1 - 2 

j=i i=i 



where wc used the induction hypothesis to derive the second equality (recall that now 
p > 2), therefore the claim holds in this case. 

Secondly, we consider the case p = 1. In this case, ends with a zero if and only 

if ai-i — 0, while always begins with a zero. Thus the members of P(w^'^) are 

classified into the three types; those induced by P(u'^— i^) for the first two blocks 
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in the first position in the second w^''' (when ai-i = 0), and the first position in 
the last block 010110^""' (when ctj-i = 0). Summarizing, we have 

TTi = 27ri_i + 2(1 - = 2 ^2'"^ ~ ^ ~ 2'"'"'"^ + "i-i j + 2 - 2a,_i 

i—l i 

= T-2-Yl 2'"^"j = 2' - 2 - J] 2^-^aj- + , 
j=i i=i 

where we used the induction hypothesis to derive the second equality (recall that now 
p = 1), therefore the claim holds in this case. Hence Lemma [TH holds. □ 

Lemma [TH implies the following relation: 

5^1 — 2£i = SvTj + 3 — 36p^iai for any i > 1 . (16) 

Lemma fT4l gives the values of |Z(w*^"^)| and \P{w^'^^)\ for special initial subwords w^"'^ = 
w^*^ of w. To consider a general case, we present the following decomposition of any 
(proper) initial subword of w: 

Lemma 15. Each finite initial subword w^"'^ of w is decomposed as 

^(n) ^ w{il)^{i2) . . . ^(*fe-l>(^fe))A+l^; , (17) 

where k > 1, ii > 12 >■■■> ik > 0, \ E {0,1} , v is a (possibly empty) initial subword of 
010110P-"'fe+S and ik>lifk>2. 

Proof. Since w is the limit of words w^'^\ it suffices to show that every initial subword u 
of each w^'^\ m > 0, is expressed as in ffT7|) . We proceed the proof by induction on m. 
First, in the case m < 1, such an expression of u is obtained by putting k = 1, ii = 0, 
A = 0, and v = u. From now, we focus on the case m > 2. 

Recall that w^'^'> = w'>™'~^^w^™"^^010110^~"'" by the construction. First, if u is con- 
tained in the first w^'^~^\ then the claim follows from the induction hypothesis. Secondly, 
if u is not contained in the first two blocks w^'^~^'^ w^"^~^\ then we have u = w^'^~'^'^ w^'^~^'^ x 
for an initial subword x of 010110^""™, therefore a desired expression is obtained by 
putting fc = l, Zfc = m — 1,A = 1 and v = x. Finally, in the remaining case, we 
have u = w^"^~^'^x for a nonempty proper initial subword x of w^"^~^K By the induction 
hypothesis, x can be expressed in the following form: 

where the parameters satisfy the same condition as in the statement of the lemma. Note 
that i'^ < m — 2 by the choice of x. Now a desired expression of u is obtained by putting 
k = k' + 1, ii = m — 1, ij = i'-_^ for 2 < j < fc, A = A', and v = v' . Hence Lemma [T^ 
holds. □ 

We use the decomposition (1171) of w*-"-* in the following argument. Moreover, we 
assume that n > £1 since this is sufficient for our purpose. Now we have > 1, therefore 
^A; > 1 (recall the condition that > 1 if /c > 2). Thus we have 

k k 

n = £(^W)= J]£,^, + A£.,+£(t;) , \Z{w^'^^)\ = Y,C^,+K., + \Z{v)\ . (18) 
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For the value \P{w^'^^)\, we consider the following two cases. First suppose p >2. Then 
each w^^^'^ ends with a zero regardless of the value E {0, 1}, therefore the members 
of P{w^^^) are classified into the six types; those induced by the sets P{w^^^'^) for k + \ 
blocks w^^^\ those induced by the set P{v), the first positions in the k — 2 blocks w^^^'^ 
(2 < j < k — 1), the first position in the first w^**^ (when k > 2), the first position in 
the second t;;^**^ (when A = 1), and the first position in the last block v (when f 7^ 0). 
Summarizing, we have 

k 

|P(«;W)| =J2^i, + + 1^(^)1 +k + X- (5,,0 if p > 2 . 

Secondly, suppose p = 1. Then ends with a zero if and only if ai. =0. Now the 
members of P{w^^^) are classified into the six types; those induced by the sets P(w^*^^) 
for A; + A blocks w^'^^\ those induced by the set P{v), the first positions in the blocks w^^^'^ 
with 2 < j < k — 1 (when ctj^.i = 0), the first position in the first w^**^^ (when k > 2 and 
c^ife-i = 0), the first position in the second (when A = 1 and = 0), and the first 
position in the last block v (when f 7^ and ai^, = 0). This implies that 

k k 

|P(^W)| = J2 vr., + Att,, + \P{v)\ + J](l - a,^_J + A(l - a.J + (1 - 5.,0)(1 - a.J 
j=i i=2 

k k 

= Xl^*^ + -^^^fc + 1-^(^)1 + ^ - X^ttj, + (A - 5i,,0)(l - OiJ if p = 1 . 
i=i i=i 

Sunomarizing, regardless of the value p > 1, we have 

k k 

|P(u;W)| = J^TT,^. + Att,, + |P(t;)| + A; + (A - 5,,0)(1 - 5p,ia,J - 5^,1 X]"*. • (19) 
j=i i=i 

By using the above results, we derive the following two properties: 
Lemma 16. We have lim„^oo \Z{w'^''^'>)\/n = r. 

Proof. Let n > ii. First, since a — 2^* < Yl]=i 2 •'c^i ^ C(, Lemma [TH implies that 

2\p + 5-a)-ip + 5)<e,<2\p + 5-a)-{p + 4) , 
2\p + 2-a)-{p + 2) <Q< 2\p + 2 - a) - {p + 1) . 

Thus, by putting A = Y!]=i 2*^ + A2^^ it follows from (HHD that 

k 

n< ^(2*^(p + 5-a) - (p + 4)) + A(2^'=(p + 5 - a) - (p + 4)) + (,{v) 
i=i 

= (p + 5 - a)A - (p + 4)(A; + A) + £(t;) , 

k 

|Z(u;("))| > J](2^^(p + 2-a) - (p + 2)) +A(2^Hp + 2-a) - (p + 2)) + \Z{v)\ 
= (p + 2-a)A- (p + 2)(A; + A) + |Z(t;)| , 

17 



\Z{w^'^^)\ ^ {p + 2-a)A-{p + 2){k + \) + \Z{v)\ 

n {p + h-a)A-{p + A){k + \)+^{v) ' ^ ' 

Now note that < |2'(f)| < [{v) < p + 5 by the choice of f , therefore the values |2'(f)| 
and £(f ) are bounded. On the other hand, we have k < ii < logg A, while ii — >■ cxd when 
n — s> oo, therefore we have A ^ oo and k/A ^ when n —* oo. Thus the right-hand side 
of ( 12T|) converges to {p + 2 — a)/{p + 5 — a) = r when n oo. 
A similar argument also implies, by using (fT8|) and (!20l) . that 

^ (p + 2-a)A- (p+ 1)(A; + A) + |Z(t;)| 



n (p + 5-a)A- (p + 5)(A; + A) ' 

and the right-hand side converges to {p + 2 — a)/{p + 5 — a) = r when n oo. Hence 
Lemma holds. □ 



Lemma 17. We have lim^^oo \P{w^"'^)\/n = (5r — 2)/3. 
Proof. Let n > ii. Then by (HE]), ([IH]), and ([I9]), we have 

k 



5|Z(w;W)| - 2n = ^(50, - 2^,J + A(50, - 2iiJ + 5\Z{v)\ - 2i{v) 
i=i 

k 

= 5^(37ri^ + 3 - 36.p,iai.) + A(37r,, + 3 - 3(5p,iaiJ + 5\Z{v)\ - 2i{v) 
i=i 

(k k \ 

J^TTi^ + AvTi, + A(l - 5p,iaiJ - (5p,i^ai^ J + 5|Z(f )| - 2£(t;) 
j=i j=i J 

= 3(|P(ti;("))| - \P{v)\ + - 5p,ia,J) + 5|Z(t;)| - 2£(t;) . 

Thus, by putting B = 5\Z{v) \ — 2i{v) — 3|P(i')| + 35^,^0(1 — 6p^iai^), we have 

|P(w("))| _ 5|Z(u7("))|/n-2 B 
n 3 3n 

Note that B is bounded since £(f ) < p + 5. Thus Lemma [TU] implies that the right-hand 
side converges to (5r — 2)/3 when n oo. Hence Lemma [T71 holds. □ 

Hence, by Lemmas [I6] and [IH the infinite word w satisfies the desired condition. 



4.3 Construction of Words Achieving Upper Bounds 

We show that for any < r < 1, there exists an infinite binary word w such that 
rmf{w) = Tsupiw) = r and Rin{{w) = Rsnpiw) = r. Note that w = 0000 ■■ ■ (infinite 
repetition of 0) satisfies the condition for the case r = 1. From now, we focus on the 
remaining case < r < 1. 

To construct such a word w, first define 5^ G {0, 1} for /c > 1 inductively by 

2i5- + 2k 

Sk = I if — ^TT^ — ~~: < ''^ ; ^fc = otherwise. 

k[k + 1) 
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Then it follows by the induction on k that 

Ell 2^5. 



k{k + l) 



< r for any > 1 . (22) 



Indeed, if Sk = 1, then the inequality holds by the definition of S^; while if Sk = 0, then 
the induction hypothesis implies that 



k{k + l) - {k-l)k - 

(note that 5i = and the claim indeed holds when k = 1). Now let w^'''^ denote the 
repetition of 1 — 5^ G {0, 1} of length 2k for every k > 1, and define w = w^^'^w^'^'^w^^'^ ■ ■ ■ . 
We prove that this infinite word w satisfies the desired condition. Note that 



k k 



) = ^2i = A;(A; + 1) and |Z(«;<^> ■ • • w^'^^)] = J] 225, . (23) 



i=l i=l 

Now we have the following two properties: 
Lemma 18. We have lim^^oo |2'(w*^"))|/?t, = r. 

Proof. For an arbitrary e > 0, take an integer M > such that 1/M < e/2. Then by 
we have 

1-^ E^,2^S^ + EtM,,2^ ^ ^.^ / _ 2.(1 - 6. 



n{n + 1) n->co \ n{n + 1) 

while r < 1. Thus by the definition of 5k-, we have (5x = for some K > M. We show 
that r — e < \Z{w^'^^)\/n < r for any n > [K — 1)K = l{w^^^ ■ ■ ■w^^~^'^), from which the 
claim of the lemma follows. 

For the purpose, we show, by induction on A; > i^', that r — e < \Z(w'^"'^)\/n < r for 
any (k — l)k < n < k{k + 1). Take such an n. Then we have w'-"^ = w^^'^ ■ ■ ■w^''~^'^v, 
where w is a subword of w^*^^ of length n — [k — l)k. Now if 5^ = (that is satisfied when 
k = KhY the choice of K), then ([22D and ^ imply that 



n n n {k — l)k 

while the definition of and the fact k > K > M imply that 



|Z(^("))| E--1 2^5, 2^5^ 2 2^ 



n n ~ k{k + l) k + 1 M 

where the last inequality follows from the choice of M. Thus r — e < \Z(w^"^)\/n < r if 
Sk = 0. On the other hand, if 5^ = 1 (hence k > K + 1), then we have 

|Z(w("))| _ \Z{w^^^ ■■■w^''-^^)\+e{v) ^ \Z{w^^^ ■■■w'^^-^^)\+2k 



n i{w(^) ■ ■ ■ wC"-^)) + i{v) - i{w^'^) ■ ■■w(>'-^^) +2k 
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where the last inequality holds since ■ ■ ■ w^'^' ^^)| < and < 

£(v) < 2k. Now it follows from (I22D and (121 that 



n - (A;-l)A; + 2/c + 1) 

Similarly, we have 



by the properties i{v) > and ■ ■ ■w^''^^'^)] < l{w^^^ ■ ■ ■w^^^^'^). Thus, by putting 

A;' = A; - 1, it follows from (El and (ESI) that 



n - {k-l)k k'{k' + l) 

where the last inequality follows from the induction hypothesis. Thus we have r — e < 
\Z{w^"'^)\/n < r if 5fc = 1. Summarizing, we have r — e < \Z{w^'^^)\/n < r regardless of 
the value 6k- Hence Lemma fTSl holds. □ 

Lemma 19. We have lim„^oo \P{w^"'^)\/n = r. 

Proof. First, note that w^"^ can be written as w'-"^ = w^^^ ■ ■ ■ w^'^^^'^v., where w is a subword 
of w^^'> of length n' = n — {k — l)k > 0. Now if 5^ = 0, then we have \Z{w^"'^) \ = Yli=i 2^^j 
by ( l23l) . while we have \P{w^'^'')\ > Yli=ii'^'^~^)^i by counting the subwords 00 in w^"^. On 
the other hand, if Sk = 1, then we have = Yli=i 2^'^j H"'^' by ( l23l) . while we have 

|P(w("))| > X]i=i (2^ — l)*^* + 7^' — 1 by counting the subwords 00 in w^"'\ Summarizing, 
regardless of the value 6k, we have 

~ n n ~ n ~ n 

where the first inequality follows from the fact that there exists an injection P(w*^")) 
Z(w^^^) (see the first paragraph of SectionH]). Moreover, we have k/n ^ when n — > oo, 
since n > (k — l)k hj the choice of the expression of ti?^"^. Thus we have 

lim = lim = r , 

where the second equality follows from Lemma [THl Hence Lemma [T^] holds. □ 

By Lemmas [18] and [191 the infinite word w satisfies the desired condition. Hence the 
proof of Theorem [1] is concluded. 
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